REMARKS 

Claims 2-16 and 18-32 are now pending in the application, with Claims 13 
and 29 being independent. Claims 1 and 17 have been cancelled without prejudice or 
disclaimer of the subject matter recited therein, and Claims 2, 4-7, 10-16, 18, 20-23, and 
26-32 have been amended herein. 

Applicant respectfully requests entry of this amendment as it is an earnest 
effort to place the application in condition for allowance. Specifically, Applicant has 
cancelled both rejected independent claims, and has rewritten the allowable dependent 
claims in independent form. Accordingly, Applicant submits that entry of this amendment 
is proper under 37 CFR § 1.1 16(b). 

In view of the amendments above and the remarks below, Applicant 
respectfully requests reconsideration and allowance of the present application. 

Applicant is filing herewith a Substitute Specification, along with a marked- 
up copy of the Substitute Specification, to amend the specification to address minor 
grammatical, typographical, and idiomatic informalities. Applicant submits that no new 
matter has been added. 

Initially, Applicant notes with appreciation the indication that Claims 13 
and 29 would be allowable if rewritten in independent form. Claims 13 and 29 have been 
rewritten in independent form herein. Accordingly, Applicant submits that these claims are 
now in condition for allowance. 



11 



Claims 1-11, 14-27, and 30-32 were rejected under 35 U.S.C. § 103(a) over 
WO 93/1 1631 ( Denver ) in view of U.S. Patent No. 5,565,914 (Motta). Claims 12 and 28 
were rejected under 35 U.S.C. § 103(a) over Denver and Motta in further view of U.S. 
Patent No. 6,157,420 (Nakamshi). 

Without conceding the propriety of the rejections, and solely to advance 
prosecution, Applicant has cancelled independent Claims 1 and 17, and, as discussed 
above, rewritten allowable Claims 13 and 29 in independent form. Those claims 
depending from cancelled Claims 1 and 17 have been amended herein to depend from 
either Claim 13 or 29. 

Accordingly, Applicant submits that the rejections made in the outstanding 
Office Action are now moot, and that the pending claims are in condition for allowance. 

In view of the foregoing, Applicant submits that the application is in 
condition for allowance. Favorable reconsideration and early passage to issue are 
respectfully requested. 
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Applicant's undersigned attorney may be reached in our Washington, D.C., 
office by telephone at (202) 530-1010. All correspondence should continue to be directed 
to our address below. 

Respectfully submitted, 



Attorney for Applicant 
Anne M. Maher 
Registration No. 38,231 



FITZPATRICK, CELLA, HARPER & SCINTO 
30 Rockefeller Plaza 
New York, New York 101 12-3801 
Facsimile: (212)218-2200 

AMM/agm 
DC_MAIN 180798V1 
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Applicant's undersigned attorney has reviewed the substitute specification 
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office by telephone at (202) 530-1010. All correspondence should be directed to our 
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The present invention relates to an image pickup apparatus capable of 
picking up a dynamic image or a still image, image such as a video camera. 



Related Background Art 

In a digital color camera, in response to depression of p r essing down of a 
RELEASE button, an image in a field is exposed onto to a solid-state image pickup 
element, clement such as a CCD or a CMOS sensor, sensor for a desired time 
20 period, an image signal thtts obtained thereby and representing a still image on a 
screen is converted into a digital signal and is subjected subject to predetermined 
processing, processing such as the YC processing, and an image signal of a 
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predetermined format is obtained. Digital image signals representing the picked up 
images are recorded in a semiconductor memory on a picture-bv-picture (frame) 
picture basis. The recorded image signals are read as desired and according to the 
need to be reproduced as signals capable of being displayed or printed, and are 
5 output outputt e d to a monitor or the like to be displayed. 

One example of a technology for thinning a digital color camera is 
disclosed in Japanese Patent Application Laid-Open No. 10-145802. In Japanese 
Patent Application Laid-Open No. 10-145802, an image pickup screen is divided 
into a plurality of regions, and an imaging optical system is provided for each of 

10 the regions to form a partial image of an object, wherein obj e ct. Wher e in one 
object image is formed with regard to one imaging optical system, and object 
images (the the number of which corresponds to the number of the divisions of the 
image pickup screen) sereen are projected onto a single image pickup element. 

By arranging a plurality of small island-like image pickup regions, re gions 

1 5 and by providing each of them with a small-sized imaging system, a thinner image 
pickup apparatus can be materialized. 

Generally, making larg e r the overall whol e area of the image pickup 
element larger lowers the production yield, and, due to limitation on the cost, a 
practical an upper limit is p r actically placed on the size of the image pickup 

20 element. When, as disclosed in the Japanese Patent Application Laid-Open No. 
10-145802, small island-like image pickup regions are arranged for the purpose of 
thinning the image pickup apparatus and obtaining a high definition image, it is 
necessary to make smscii at least the pixel pitch of the image pickup element small, 
in accordance with a according to the sampling theory, theory in order to make 
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high the spatial frequency, fr e quency which can be represented by the photoelectric 
conversion output of the image pickup element , high . 

In addition to this, an image pickup optical system for forming an object 
image on the image pickup element is required to have high contrast up to a higher 
5 frequency. 

The imaging performance of an imaging system is represented by a 
response function referred to as OTF. When the above characteristics are 
represented by the OTF characteristics, it is required that the response curve 
maintains high response from a low frequency to a high frequency and that once 
10 the response is lowered to zero, after that, the response thereafter does not have a 
value other than zero. 

The phenomenon that the response becomes negative after it is once 
lowered to zero is referred to as spurious resolution, re solution which depends on 
the aberration characteristics of the image pickup optical system. At a spatial 
15 frequency where the response is negative, a portion which should be black 

becomes white while a portion which should be white becomes black, and thereby 
reversal of negative/positive occurs. An imaging system which causes spurious 
resolution has a strong tendency to have low response in a medium frequency 
range. Thus, the image as a whole does not have enough contrast and detailed 
20 portions are unnaturally represented. Such an Then, such the imaging system is 
most inappropriate for recording a person or a scene. 

There are two methods of improving the aberration characteristics of an 
image pickup optical system to alleviate the problem of spurious resolution. One is 
a method of increasing the degree of freedom in designing by, for example, 



increasing the number of lenses forming the system, making the lenses 
nonspherical, using anomalous dispersion glass, or complexly using diffraction 
optical elements. The other is a method of narrowing making na r rower the 
imaging light flux. 

5 The former method, that is, the method of increasing the degree of 

freedom in designing results in complexity of the structure of the objective optical 
system. This method is therefore inappropriate for a thin image pickup apparatus. 

On the other hand, the latter method, that is, the method of using a 
narrower light flux conforms to a thin image pickup apparatus. However, when the 

10 light flux is narrowed to a certain extent or more, another problem arises in that the 
contrast in a high frequency range is decreased due to diffraction of light. In this 
state, an image is formed including of a bright spot at the center and diffraction 
stripes surrounding the bright spot. These are caused by relative increase in the 
intensity of the diffraction stripes due to peripheral waves generated on the 

15 periphery of the diaphragm opening. This can be understood also from the fact 
that, if the diaphragm radius is reduced by b e comes !4 times , the periphery of the 
opening is reduced by i4, becomes Vi times while the area of the opening is 
reduced to l A b e comes 1/4 tim e s . 

Therefore, conventionally, it is difficult to materialize a simply structured 

20 image pickup optical system which obtains a high definition image corresponding 
to a small pixel pitch. 
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SUMMARY OF THE INVENTION 

According to one aspect of the present invention, there is provided an 
image pickup apparatus comprising a plurality of image pickup portions for 
receiving different wavelength components of object light, and a plurality of 
5 optical systems for guiding the object light to the plurality of image pickup 
portions, respectively, each of the plurality of optical systems having a filtering 
function whose transmission factor becomes smaller as the distance from an optical 
axis thereof becomes longer. The image pickup apparatus of the present invention 
is small-sized and has high image quality. 
10 Other aspects of the present invention will become apparent from the 

following preferable specific embodiments. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a sectional view of an image pickup system of a digital color 
1 5 camera according to an embodiment of the present invention; 

Fig. 2 is a front view of a solid-state image pickup element of the image 
pickup system shown in Fig. 1 ; 

Fig. 3 is a front view of a diaphragm of the image pickup system shown in 

Fig. 1; 

20 Fig. 4 illustrates the ranges where optical filters of the image pickup 

system shown in Fig. 1 are formed; 

Fig. 5 illustrates an objective lens of the image pickup system shown in 
Fig. 1 which is viewed from the side where light is projected; 
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Fig. 6 is a graph showing the spectral transmission factor characteristics of 
the optical filters of the image pickup system shown in Fig. 1; 

Fig. 7 is a graph showing the spectral transmission factor characteristics of 
a color purity correction filter of the image pickup system shown in Fig. 1; 
5 Fig. 8 is a graph showing the spectral transmission factor characteristics of 

a photochromic glass of the image pickup system shown in Fig. 1 ; 

Fig. 9 is a graph showing the transmission factor distribution of a 
transmission factor distribution type filter of the image pickup system shown in 
Fig. 1; 

10 k Fig. 10 is a graph showing the OTF characteristics of the objective lens of 
the image pickup system shown in Fig. 1 ; 

Fig. 1 1 is a graph showing the intensity distribution in an image by the 
image pickup system shown in Fig. 1 ; 

Fig. 12 is an explanatory view for explaining the setting of the intervals ; 
15 between lens portions of the image pickup system shown in Fig. 1 ; 

Fig. 13 is an explanatory view for explaining the positions of images of an 
object at infinity of the image pickup system shown in Fig. 1 ; 

Fig. 14 is a block diagram of a signal processing system of the digital 
color camera shown in Fig. 1 ; 
20 Fig. 15 illustrates the positional relationship of the image pickup region 

for R and B pixels with respect to the image pickup region for a G pixel of the 
image pickup system shown in Fig. 1 ; 

Fig. 16 is an explanatory view of interpolation processing of the digital 
color camera shown in Fig. 1 ; 
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Figs. 17 A, 17B, and 17C illustrate the overall structure of the digital color 
camera shown in Fig. 1 ; 

Fig. 1 8 is a graph showing a transmission factor distribution of a 
transmission factor distribution type filter according to a second embodiment of the 
5 present invention; 

Fig. 1 9 is a front view of the transmission factor distribution type filter 
shown in Fig. 18; 

Fig. 20 is a graph showing a transmission factor distribution of another 
transmission factor distribution type filter according to the second 
1 0 embodiment of the present invention; 

Fig. 21 is a sectional view of an image pickup system according to a third 
embodiment of the present invention; and 

Fig. 22 is a sectional view of another image pickup system according to * 
the third embodiment of the present invention. 

15 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Preferred embodiments of the present invention are now described in 
detail with reference to the drawings. 

First of all, the overall structure as a whole of a digital color camera using 
20 the present invention and its signal processing system are described. 

Figs. 17A, 17B, and 17C illustrate the overall structure of a digital color 
camera according to a first embodiment of the present invention. 

Figs. 17 A, 17C, and 17B are a front view, a rear view, and a sectional 
view taken along the line 17B-17B in the rear view of Fig. 17C, respectively. 
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In Figs. 17 A, 17B, and 17C, reference numeral 1 denotes a camera body. 
An illuminating light intake window 2 formed of a white diffusing plate is 
positioned at the back of a color liquid crystal monitor 4. Reference numerals 5 
and 6 denote a main switch and a RELEASE button, respectively. Reference 
5 numerals 7, 8, and 9 are switches for a user to set the state of the camera. In 
particular, the reference numeral 9 denotes a PLAY button. A reference numeral 
13 denotes a display of the remaining number of recordable pictures. Object light 
which is incident on into a prism 12 from a viewfinder front frame 3 is projected 
from a viewfinder eyepiece window 11. Reference numerals 10 and 14 denote an 

10 image pickup system and a connection terminal for connecting to an external 
computer or the like to transmit and receive data, respectively. 

The schematic structure of a signal processing system is now described. 
Fig. 14 is a block diagram of the signal processing system. This camera is a single 
plate type digital color camera using a solid-state image pickup element 120, -t26 

1 5 such as a CCD or a CMOS sensor. Image signals representing a dynamic image or 
a still image are obtained by driving the solid-state image pickup element 120 
continuously or only once, respectively, once. Here, the solid-state image pickup 
element 1 20 is an image pickup device of the type which converts ex posure 
exposed light into electric signals with regard to the respective pixels, stores 

20 respective charges according to the light amount, and reads the respective charges. 
It is to be noted that Fig. 14 only shows portions which are directly 
relevant to the present invention, and illustration and description of portions which 
are not directly relevant to the present invention are omitted. 
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As shown in Fig. 14, the image pickup apparatus includes has the image 
pickup system 1 0, an image processing system 20 as an image processing means, a 
recording and reproduction system 30, and a control system 40. Further, the image 
pickup system 10 includes therein an objective lens 100, a diaphragm 110, and the 
5 solid-state image pickup element 120; +26; the image processing system 20 

includes therein an A/D converter 500, an RGB image processing circuit 210, and a 
YC processing circuit 230; 290; the recording and reproduction system 30 includes 
therein a recording processing circuit 300 and a reproduction processing circuit 
310; 3+6; and the control system 40 includes therein a system control unit 400, an 
10 operation detection circuit 410, and a drive circuit 420 of the solid-state image 
pickup element. 

The image pickup system 10 is an optical processing system for imaging 
light received incid e nt from an object, object through the diaphragm 110 and the 
objective lens 100, and incident on an image pickup plane of the solid-state image 

15 pickup element. The light transmission factor of the objective lens 100 is adjusted 
to expose a subject image of an appropriate light amount onto to the solid-state 
image pickup element 120. As described in the above, as the solid-state image 
pickup element 120, an image pickup device, device such as a CCD or and a 
CMOS sensor, may be used, senso r is applied. By controlling the exposure time 

20 and the exposure intervals of the solid-state image pickup element 120, image 
signals representing continuous dynamic images or image signals representing a 
still image by one exposure can be obtained. 

Next, the image pickup system 10 is described with reference to Fig. 1 . In 
the present embodiment, the objective lens 100. +66 which is an image pickup 
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optical system of the-image pickup system -H) is provided with transmission 
factor distribution type filters 54a, 54b, and 54c which are optical filtering means 
according to the present invention. 

Fig. 1 is a detailed view of the image pickup system 10. First, the 
5 diaphragm 110 has three circular openings 1 10a, 1 10b, and 110c, 110c as shown in 
Fig. 3. Object light which enters a light incidence plane lOOe of the objective lens 
100 from the openings is are projected from three lens portions 100a, 100b, and 
100c of the objective lens 100 to form three object images on the image pickup 
plane of the solid-state image pickup element 120. The diaphragm 110, the light 

1 0 incidence plane 1 OOe, and the image pickup plane of the solid-state image pickup 
element 120 are provided in parallel with one another. In this way, by making 
weak the power on the incidence side weak , making strong the power on the 
projection side strong , and providing a diaphragm on the incidence side, the 
curvature of the image plane can be reduced made less . It is to be noted that, 

15 though the light incidence plane lOOe of the objective lens 100 is a plane here, the 
light incidence plane lOOe may be formed by of three spherical surfaces or three 
rotation symmetry nonspherical surfaces. 

The three lens portions 100a, 100b, and 100c have circular spherical 
surface portions, portions as shown in Fig. 5. which illustrates 5 showing the 

20 objective lens 100 viewed from the side where light is projected. An infrared 
radiation cutting filter having a low transmission factor with regard to a to the 
wavelength range of 670 nm and greater more is formed on the spherical surface 
portions, portions while a light-shielding film is formed on a plane portion lOOd 
shown with hatching. More specifically, the objective optical system is formed by 
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with the objective lens 100 and the diaphragm 110, while the three lens portions 
100a, 100b, and 100c form arc the imaging system. 

The manufacturing is made easy by with using glass molding in the case 
where the objective lens 100 is made of glass, glass and by with using injection 
5 molding in the case where the objective lens 100 is made of resin. 

Fig. 2 is a front view of the solid-state image pickup element 120. The 
solid-state image pickup element 120 is provided with three image pickup regions 
120a, 120b, and 120c corresponding to the formed three object images formed by 
the objective lens . Each of the image pickup regions 120a, 120b, -t2b; and 120c are 

10 sized to be 2.24 mm x 1 .68 mm with the arrangement of 800 x 600 pixels having 
the vertical and horizontal pitches pitch of 2.8 [am. The size of the overall whole 
image pickup region r e gions is 2.24 mm x 5.04 mm. The diagonal size of each of 
the image pickup regions is 2.80 mm. In Figure 2, the figure, image circles 51a, 
51b, and 51c, 51c within each of which an object image is formed, formed are 

15 circular, the sizes of which circles are determined by the size of the openings of the 
diaphragm and the spherical surface portions on the projection side of the objective 
lens 100. The image circles 51a and 51b overlap each other and the image circles 
51b and 51c overlap each other. 

In Fig. 1, hatched portions 52a, 52b, and 52c sandwiched between the 

20 diaphragm 110 and the objective lens 100 are optical filters formed on the light 
incidence plane lOOe of the objective lens 100. As shown in Fig. 4 , which 
illustrates showing the objective lens 100 viewed from the light incidence side, the 
optical filters 52a, 52b, and 52c are formed in regions which completely include 
the diaphragm openings 1 10a, 1 10b, and 1 10c, respectively. 
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The optical filter 52a has spectral transmission factor characteristics 
shown as G in Fig. 6 , that is. which mainly transmitting transmit green; green; the 
optical filter 52b has spectral transmission factor characteristics shown as R , that 
is. which mainly transmitting transmit red: red, and the optical filter 52c has 
5 spectral transmission factor characteristics shown as B , that is, which mainly 
transmitting transmit blue; blu e , and thus, these are primary color filters. As the 
product with the characteristics of the infrared radiation cutting filter formed on the 
lens portions 100a, 100b, and 100c, the object images formed in the image circles 
51a, 51b, and 51c are of green light component, red light component, and blue light 
1 0 component, respectively. 

On the other hand, optical filters 53a, 53b, and 53c are formed on the 
three image pickup regions 120a, 120b, and 120c, respectively, of the solid-state 
image pickup element 120. Their spectral transmission factor characteristics are 
equivalent to the ones shown in Fig. 6. More specifically, the image pickup 
15 regions 120a, 120b, and 120c are sensitive to green light (G), red light (R), and blue 
light (B), respectively. 

Since the spectral distributions of the received light of the respective 
image pickup regions are given as the product of the spectral transmission factors 
of the pupils and the spectral transmission factors of the image pickup regions, 
20 respectively, each the combination of a pupil the pupil and an fee image pickup 
region is selected according to the wavelength range. More specifically, object 
light which goes through the diaphragm opening 1 10a is mainly photoelectrically 
converted in the image pickup region 120a, object light which goes through the 
diaphragm opening 1 10b is mainly photoelectrically converted in the image pickup 
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region 120b, and object light which goes through the diaphragm opening 1 10c is 
mainly photoelectrical^ converted in the image pickup region 120c. In other 
words, the image pickup regions 120a, 120b, and 120c output a G image, an R 
image, and a B image, respectively. In this way, by using multiple optical filters 
5 for the purpose of color separation on the pupils of the image pickup optical system 
and on the image pickup element, the color purity can be enhanced. This is 
because, by using the same kind of optical filters twice, the buildup of the 
transmission factor characteristics becomes steeper and the red color (R) and the 
blue color (B) do not overlap each other. It is to be noted that the transmission < 

10 factors of the optical filters 52a, 52b, and 52c or of the optical filters 53a, 53b, andV 
53c are preferably set so as to provide appropriate signal levels in the respective 
image pickup regions in the same accumulation time. 

In the image processing system 20, a color image is formed based on the 
selective photoelectric conversion output obtained from the plurality of images by , . * 

15 the plurality of image pickup regions of the solid-state image pickup element 120, 
respectively. Here, since the peak wavelength of the spectral luminous efficiency 
is 555 nm, the signal processing is carried out using a G image signal including this 
wavelength, as the reference image signal. 

When the pixel pitch of the solid-state image pickup element is fixed, 

20 compared with a system adopted generally by a digital color camera in which an 
RGB color filter is formed on the solid-state image pickup element with, for 
example, 2x2 pixel block basis to provide wavelength selectability to each pixel, 
and thus, an object image is separated into RGB images, the size of the object 
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image is 1/ a/3 times, and thus, the focal length of the objective lens is about 

1/ a/3 times, which is quite advantageous in thinning the camera. 

It is to be noted that, with regard to the spectral transmission factor 
characteristics of the optical filters 52a, 52b, and 52c and of the optical filters 53a, 
5 53b, and 53c, as shown in Fig. 6, R and G overlap each other and G and B overlap 
each other, though R and B are almost separated from each other. 

Therefore, even when the image circle 51b of the red light overlaps the 
image pickup region 120c for photoelectrically converting the blue light, and 
conversely, even when the image circle 51c of the blue light overlaps the image 

10 pickup region 120b for photoelectrically converting the red light, these images do 
not become the output of the image pickup regions. However, at the portion where 
the image circle 51b of the red light overlaps the image pickup region 120a for 
photoelectrically converting the green light and at the portion where the image 
circle 51a of the green light overlaps the image pickup region 120b for 

15 photoelectrically converting the red light, a small amount of an image of a different 
wavelength which should be blocked is superimposed. More specifically, since the 
selectivity of the object image is given by the product of the spectral transmission 
factor characteristics of the optical filter 52a and the spectral transmission factor 
characteristics of the optical filter 53b, and by the product of the spectral 

20 transmission factor characteristics of the optical filter 52b and the spectral 

transmission factor characteristics of the optical filter 53a, the cross talk of the R 
image signal and the G image signal does not become zero, zero although it is 
small. 
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Therefore, the objective lens 100 is further provided with characteristics to 
lower the transmission factor of the wavelength range of the portion where R and G 
overlap each other. This can be carried out by using optical filtering technology 
implemented by a color purity correction filter. 
5 The color purity correction filter is an optical filter formed of a base 

material made of a transparent synthetic resin or glass having a predetermined 
amount of rare-earth metal ions contained therein. 

As the rare-earth metal ions, one or more selected among neodymium ions, 
praseodymium ions, erbium ions, and holmium ions are used. However, it is 
■ s 10 preferable that at least neodymium ions are used as indispensable ions. It is to be/ 
noted that tri valence ions are generally used as these ions. The content of the metal 
ions is selected in a range of normally 0.01 to 40 mass parts, preferably 0.04 to 30 
mass parts relative to 100 mass parts of the base material of the objective lens 100. 
As shown in Fig. 7, the color purity correction filter has characteristics to 
15 selectively absorb light in a predetermined wavelength range between the peak 
wavelengths of the color components of R, G, and B to decrease the amount of 
transmission thereof. This action almost eliminates cross talk due to the overlap 
of the image circle 51b of the red light and the image pickup region 120a for 
photoelectrically converting the green light, light and the overlap of the image circle 
20 51a of the green light and the image pickup region 120b for photoelectrically 
converting the red light. 

Further, the objective lens 100 is also provided with photochromic 
characteristics, characte r istics which is a phenomenon to be darkened by light and 
to be reversibly achromatized when the irradiation of light is stopped. The reason 
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for this is. This is for, since the accumulation time control range of the solid-state 
image pickup element 120 is limited, to suppress suppr e ssing the amount of light 
reaching the solid-state image pickup element when the field is extremely bright, 
thereby enlarging the recordable intensity range. 
5 As the photochromic glass, for example, photochromic glass of phosphate 

glass made by Chance-Pilkington, Chance Pilkington which has been put to 
practical use for spectacles (Product name: Reactolite Rapide), Rapid e ) may be 
used. 

Fig. 8 is a graph showing the spectral transmission factor characteristics of 
TO a photochromic glass used as the objective lens 100. In Fig. 8, a solid line shows 
the characteristics after exposure to sunlight for 20 minutes, minutes while a broken 
line shows the characteristics with no exposure to sunlight. When the 
camera is carried about with the user outdoors under a blue sky or the like, light 
beams which enter the objective lens 100 from the diaphragm 110 make makes the 
15 objective lens 100 itself darken so as darkened to suppress the amount of light 

entering the solid-state image pickup element 120 by to be about Vi. As a result, the, 
accumulation time can be made twice as long, which raises the control limitation on 
the high intensity side. 

The screen size of each of the image pickup regions 120a, 120b, and 120c is 
20 2.24 mm x 1 .68 mm, mm as described in the above, since the pixel pitch is 2.8 |-im 
and the number of the pixels is arc 800 x 600. The diagonal screen size of each of 
the image pickup regions is 2.80 mm. Generally, when the image pickup angle 0 of 
a small-sized camera is about 70° in the diagonal direction, the camera is most 
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convenient. When the image pickup angle is 70°, the focal length is 2.0 mm in this 
case, since it is determined by the diagonal size of the screen. 

When a person or the like is the subject of recording, considering that a 
person is about 170 cm tall and one person to three people are often recorded at a 
5 time, a virtual distance D to the subject [m] can be defined as in the following 
equation (1) as a function of the image pickup angle 0[°]: 

D= 1.4 /tan (6/2) . . . (1) 

Substituting 70° for 0 in of equation (1) } D = 2.0 m is obtained. Here, if 
10 the image pickup system 10 is formed so as to focus on the subject best when the * 
distance to the subject is 2 m, the letting out of the lens from the point at infinity is 
0.002 mm. Taking into consideration the allowable circle of confusion to be 
* described later, there causes practically no problems are created, problem even if 
the image pickup system is a fixed focus image pickup optical system without a 
1 5 mechanism for letting the lens out. 

A focal length f of a planoconvex lens disposed put in the air can be 
represented as follows: 

f={l/(l-n)}r ...(2) 
wherein n is the index of refraction and r is the radius of the spherical surface. 
20 Therefore, if the index of refraction n of the objective lens 100 is 1.5, for example, r 
for obtaining the focal length of 2.0 mm is 1.0 mm. 

It is convenient to make equal the sizes of the red, green, and blue object 
images, since there is no need to make correction of the image magnification, and 
thus, the processing time is not elongated. Therefore, the lens portions 100a, 100b, 
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and 100c are optimized for the peak wavelengths of 530 run, 620 nm, and 450 run 
of the light lights which respectively goes go through the RGB optical filters, so as 
respectively to make equal the magnifications of the respective images. This can be 
paraxially materialized by making equal the distance from the positions of the 
5 principal points of the respective lens portions to the solid-state image pickup 
element. 

In the case of glass, which has an glass with th e index of refraction of 
the d line (587.6 nm) n d = 1.5 and an the Abbe number v d = 60, the indexes of 
refraction at the wavelengths of 530 nm, 620 nm, and 450 nm are about 1.503, 
10 1 .499, and 1 .509, respectively. If all the radii r of the spherical surfaces of the leris 
portions 100a, 100b, and 100c equal -1.0 mm, the focal lengths at the respective 
wavelengths are, by the equation (2), as follows: 

a the lens portion 100a having the representative wavelength of 530 nm : r 
1.988 mm, 

15 a the lens portion 100b having the representative wavelength of 620 nm : 

2.004 mm, and 

a the lens portion 100c having the representative wavelength of 450 nm : 
1.965 mm. 

Suppose from the pixel pitch that the allowable circle of confusion is 3.0 
20 p,m. pm and further suppose that the f-number of the objective lens is F5.6, then the 
depth of focus represented as the product of the two is 16.8 \xm. It can be seen that 
the difference 0.039 mm between the focal length in the case of 620 nm and the 
focal length in the case of 450 nm already exceeds this. More specifically, though 
the paraxial image magnifications are the same, depending on the color of the 



- 19- 

subject, the subject may be out of focus. Since the spectral transmission factor of 
an object normally ranges over a wide wavelength range, it is quite rare that a sharp 
image in focus can be obtained. 

Accordingly, the radii r of the spherical surfaces of the lens portions 100a, 
5 100b, and 100c are optimized with regard to the respective representative 

wavelengths. More specifically, here, no achromatism for removing the chromatic 
aberration over the overall whole visible region is not carried out, otrt and designs 
for the wavelengths are applied to the respective lenses. First, the equation (2) is 
transformed to obtain the following equation (3): 
10 r = (l-n)f ... (3) 

Inserting f = 2.0 and inserting in sequence n = 1.503, n = 1.499, and n = 
1.509 in the equation (3), the following respective radii are calculated: 

a the lens portion 100a having the representative wavelength of 530 nm : 
15 r =-1.006 mm, 

a the lens portion 100b having the representative wavelength of 620 nm : 
r = -0.998 mm, and 

a the lens portion 100c having the representative wavelength of 450 nm : r 
= -1.018 mm. 

20 In order to make well-balanced the difference in the image magnifications 

at a high position of an image, the heights of the vertices of the lens portions 100a, 
100b, and 100c are slightly adjusted, and then, both the sharpness and the image 
magnification are ideal. Further, non-spherical surfaces are used for the respective 
lens portions to satisfactorily correct the curvature of the image plane. With regard 
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to the distortion of the image, it can be corrected in the signal processing to be 
carried out later. 

In this way, when reference G image signals by corresponding to the green 
object light including the wavelength of 555 run, nm which has the highest 
5 luminosity factor, factor and image signals by corresponding to the red and blue 
object lights, respectively, are obtained, and different focal lengths are set (the lens 
portions 100a to 100c are set at different focal lengths length with regard to light 
other than the spectral distributions having the above representative wavelengths) 
with regard to one wavelength (for example, green of the wavelength of 555 nm 

1 0 having the highest luminosity factor) and a substantially equal focal length is set 
with regard to the representative wavelengths in the respective spectral distribution 
in the imaging system, then by compositing these image signals, a color image with 
satisfactory correction of the chromatic aberration can be obtained. Since each of 
the imaging systems is formed of one lens, there also can be also attained the 

1 5 technological advantage of thinning the imaging system. Further, though 
achromatism normally requires a combination of two lenses having different 
dispersions, the achromatism is carried out here by only one lens, and thus, there 
also can be aiso attained the technological advantage of lowering the cost. 

The objective lens 100 is required to have high contrast image dissection 

20 up to a the spatial frequency range as high as the pixel pitch. The image pickup 
system 10 takes in three object images with regard to the three wavelength ranges, 
and thus, compared with an image pickup system provided with a mosaic optical 
filter, filt e r such as of the Bayer arrangement. Daiycr arrang e ment having the same 

number of pixels, as described in the above, the required focal length is about 1/ V3 
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times to attain the same image pickup angle. Therefore, it is necessary to 
materialize high contrast image dissection of the higher spatial frequency 
component. The optimization with regard to the respective wavelengths of the lens 
portions described in the above is a technology for suppressing the chromatic 
5 aberration for the purpose of materializing this. 

Generally, there are two methods of improving the aberration 
characteristics of an image pickup optical system to make spurious resolution less 
liable to occur, thereby alleviating problems: one is to increase the degree of 
freedom in designing by, for example, increasing the number of lenses forming the 
10 system, by making the lenses nonspherical, using anomalous dispersion glass, or by 
complexly using diffraction optical elements; and the other is to make narrower the 
imaging light beam. 

The former method, that is, increasing inc r eas e of the degree of freedom in 
designing is, though the focal length is 1/ V3 times, tends to make toward 

1 5 compl e xity of the structure of the objective optical system more complex , which 
goes against thinning of the image pickup apparatus, and thus, is inappropriate. On 
the other hand, the latter method, that is, use of a narrower light beam, b e am 
conforms to a thin image pickup apparatus. 

When an imaging light beam is made narrower, as shown by a solid line b 

20 in Fig. 1 0, the response function referred to as OTF presents gradual monotone 

decrease in the low frequency component, and after that, becomes slightly negative, 
and then, becomes slightly positive. On the other hand, in the case where a broad 
light beam without narrowing is used, as shown by a broken line a in Fig. 10, the 



-22- 

response function presents steep decrease in the low frequency component, and 
after that, becomes temporarily negative, and then, becomes positive again. 

The state where the OTF is negative indicates occurrence of spurious 
resolution. This corresponds to an actual state where reversal of negative/positive 
5 occurs, that is, a portion which should be white is black while a portion which 
should be black is white. It makes it clear that a natural image can be obtained by 
making narrower the imaging light beam. 

However, when the imaging light beam is extremely narrowed, the 
contrast in a high frequency range is decreased due to diffraction of light. In this 
10 state, an image is formed having of a bright spot at the center and diffraction stripes 
surrounding the bright spot. These are caused by, as is known well, relative 
increase in the intensity of the diffraction stripes due to peripheral waves generated 
on the periphery of the opening of the diaphragm. 

The diffraction stripes can be decreased by adding to the objective lens a 
1 5 filter which is transparent at the center and becomes darker toward the periphery. 
This method is referred to as apodization, which is described in detail on pages 172 
to 174 of "Kogaku Gijutsu Handbook Zohoban (Handbook of Optical Technology, 
Enlarged Edition)" (1975, Asakura Shoten). 

Fig. 9 is a graph showing the transmission factor distribution of 
20 transmission factor distribution type filters provided oh the light incidence plane 

l OOe of the objective lens 100 so as to face the diaphragm openings 1 10a, 1 10b, and 
1 10c. The transmission factor distribution type filters are denoted as 54a, 54b, and 
54c in Fig. 1 . The positions where the transmission factor is the highest correspond 
to the centers of the diaphragm openings 1 10a, 1 10b, and 110c, 110c while the 
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positions where the transmission factor is zero correspond to the periphery of the 
openings 1 10a, 1 10b 5 and 1 10c, respectively, of the diaphragm. In other words, the 
transmission factor is distributed so as to be the highest at the centers of the 
diaphragm openings and so as to monotonically decrease toward the periphery. 
5 Such a transmission factor distribution type filter is formed by forming a 

thin film of Inconel, Chromel, chromium or the like by vapor deposition or 
sputtering on the light incidence side of the objective lens 100. The characteristics 
shown in Fig. 9 can be obtained by making the thin film the thinnest at the center 
and the thickest on the periphery. It is to be noted that, in forming such a thin film, 
10 the position of a mask used in the vapor deposition or sputtering is continuously 
controlled. 

Though the transmission factor distribution type filters 54a, 54b, and 54c 
are formed on the objective lens here, the structure may be that they are formed on a 
glass plate and are arranged on the light incidence side or the light projection side - 

15 of the objective lens 100. 

Fig. 1 1 is a graph showing the intensity distribution in an image. In Fig. 
11 the figu r e , a broken line a shows a case where the transmission factor is constant 
over the whole diaphragm opening, while a solid line b shows a case where the 
transmission factor is decreased from the center of the diaphragm opening toward 

20 the periphery. Compared with the case of the characteristics shown by a, there is no 
bound on the periphery of the image in the characteristics shown by b, which 
clearly shows that the image formed is satisfactory. Here, this reflects the : Fhis 
r cfc r ccts technological advantage of decreasing the diffraction stripes by decreasing 
peripheral light beams by means of apodization. 
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Next, the relationship between the objective lens and the image pickup 
regions is described. Since the image pickup system has three lens portions, the 
positions of the three object images relatively change according to the distance to 
the subject. As described in the above, each of the image pickup regions is sized 
5 to be 2.24 mm x 1.68 mm, and the image pickup regions are arranged adjacent to 
each other with their long sides being in contact with each other. Therefore, the 
center-to-center cent e r to cent e r distance of adjoining image pickup regions is 1 .68 
mm. In the YC processing circuit 230. 236 to be described later, signal processing 
is carried out on the assumption that the center of an object image is the center of 

10 the image pickup region. When an object image with the virtual object distance of ?- 
2 m is to be formed on the image pickup portion at the same intervals as that 
distance, as shown in Fig. 12, the interval between the lens portions 100a and 100b 
and between the lens portions 100b and 100c is set to be 1 .6783 mm. In Fig. 12 the 
figu r e , arrows 55a, 55b, and 55c denote imaging systems having positive power by ^ : 

15 the three lens portions 100a, 100b, and 100c of the objective lens 100, respectively, 
rectangles 56a, 56b, and 56c denote the ranges of the image pickup regions 120a, 
120b, and 120c, respectively, and LI, L2, and L3 are optical axes of the imaging 
systems 55a, 55b, and 55c, respectively. Since the light incidence surface of the 
objective lens 100 is a plane, plane and the lens portions 100a, 100b, and 100c. 

20 which form 100c to be the light projection surfaces, surface are spherical surfaces, 
perpendicular lines perpendiculars from the respective centers of the spheres to the 
light incidence plane lOOe define are the optical axes. 

Here, as shown in Fig. 13, images of an object at infinity are formed at the 
same intervals as that of the lens portions 100a, 100b, and 100c, and thus, the 
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interval between the G object image and the R object image and the interval 
between the R object image and the B object image are 1.6783 mm, which is a little 
smaller than the center-to-center distance of the image pickup regions of 1 .68 mm. 
The difference AY is 0.0017 mm, i.e., 1.7 |am. With the G object image, image 
5 which has the highest luminosity factor, factor being as the reference object image, 
when the B object image moves, the difference AY is doubled and is 3.4 |j,m. Since 
it is often the case that a short-range object, object such as a person, person is 
positioned in the middle of a picture to be picked u^ tip and that a long-range 
object is positioned on the periphery of the picture, and, since the aberration of the 

10 objective lens increases on the periphery of the picture so as to lower the quality of 
an image, it can be understood that there is practically no problem arises if the 
maximum image interval change is smaller than the pixel pitch multiplied by two. 
As described iirthe above, since the pixel pitch P of the solid-state image pickup 
element 120 is 2.8 [im, it follows that AY < 2 x P, and thus, the color 

15 misalignment in an image at infinity to this extent is allowable. 

Further, the interval between the images also varies also according to a 
temperature change of the image pickup system 10. Since the imaging 
magnification of the image pickup system 10 is extremely small, the image interval 
variation AZ can be expressed as the difference between the expansion of the 

20 objective lens and the expansion of the solid-state image pickup element in the 
following equation (4): 

Z = 1.68 x (aL - cc S) x AT ... (4) 
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wherein aS is the coefficient of linear expansion of the solid-state image pickup 
element 120, ccL is the coefficient of linear expansion of the objective lens 100, and 
AT is the temperature change. 

Here, when aS = 0.26 x 10* 5 , AT = 20[°C], and the objective lens 100 is 
5 formed of low-melting glass and aL = 1.2 x 10" 5 , AZ is calculated at 0.00032 [mm]. 
This is the variation in the interval between the G object image and the R object 
image and the variation in the interval between the R object image and the B object 
image. 

When the B object image is regarded as a variation with respect to the G 
10 object image, image which is the reference image signal signals , since the interval 
between the images is 1 .68 x 2, the image interval variation is AZ x 2 = 0.00063 
[mm]. When the temperature range where the camera is used is 0 to 40°C, the 
deviation AT from the reference temperature of 20°C is 20°C. Here, if AZ x 2 is 
smaller than 1/2 of the pixel pitch, th e r e is practically no problem arises . Generally, 
15 the coefficient of linear expansion aS of the solid-state image pickup element 120 
is as small as about 0.26 x 10" 5 , and it is necessary to select the coefficient of linear 
expansion aL of the objective lens 100 so as to satisfy the following expression (5): 
2 x A x (aL - 0.26 x 10" 5 ) x 20 < l A P ... (5) 

wherein A is either the interval between the G image and the R image or the 
20 interval between the R image and the B image and P is the pixel pitch. 

Since the coefficient aL (= 1.2 x 10" 5 ) of linear expansion of the objective 
lens 100 used in the above satisfies the relationship expressed by the expression (5), 
it can be understood that the material of the lens 100 is suitable for the camera. 
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Further, apart from the fluctuation of the image interval due to the distance 
to the object and due to temperature change, a method referred to as pixel shift is 
used where, by shifting relatively the image pickup regions 120a, 120b, and 120c of 
the solid-state image pickup element by 1/2 pixel, the resolution is made higher 
5 with a small number of pixels. The amount of the shift of 1/2 pixel is set with 
regard to the virtual object distance of 2 m. 

As shown in Fig. 15, the image pickup region 120b for outputting the R 
image signals and the image pickup region 120c for outputting the B image signals 
are arranged so as to be shifted by Vi pixel both in the horizontal direction and in 
1 0 the vertical direction with respect to the image pickup region 120a for outputting the 
G image signals. 

This pixel shift may be materialized by making the lens portions 100b and 
100c of the objective lens 100 slightly offset with respect to the lens portion 100a, 
or may be materialized by making the image pickup regions 120b and 120c of the : 

15 solid-state image pickup element 120 slightly offset with respect to the image 
pickup region 120a. 

In an optical filter arrangement such as the Bayer Daiy e r arrangement, 
since, for example, a pixel provided with a red optical filter or a pixel provided 
with a blue optical filter is arranged between pixels provided with a green optical 

20 filter, an optical low-pass filter for suppressing aliasing is necessary. However, in a 
case in which of that images having different spectral distributions are taken in with 
regard to different image pickup regions, pixels provided with the respective optical 
filters can be densely arranged, and, as a result, the influence of the aliasing is 
small, and thus, a high definition image can be obtained without the need for an the 
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optical low-pass filter. This makes it possible to miniaturize the image pickup 
system and to substantially lower the cost. 

Next, the signal processing is described. 

As described irrthe above, an image pickup device having 1,800 pixels in 
5 its lengthwise direction and 800 pixels in its breadthwise direction, i.e., having 
1,440,000 pixels in total, total is effectively applied to the solid-state image pickup 
element 120. Optical filters of the three primary colors, that is, red (R), green (G), 
and blue (B), are arranged on its front surface in predetermined regions, regions 
respectively. 

10 As shown in Fig. 14, image signals read from the solid-state image pickup 

element 120 are supplied to the A/D converter 500 of the image processing system 
20. The A/D converter 500 is, for example, a signal converting circuit for 
converting the signals into digital signals of, for example, ten bits according to the 
amplitude of the signal of each pixel, pix e l and for outputting the converted signals. 

15 Then, the image signal processing is carried out in digital processing. 

The image processing system 20 has a signal processing circuit for 
obtaining image signals of a desired format from R, G, and B digital signals, and 
converts the for conv e rting R, G, and B color signals into YC signals expressed by 
a luminance signal Y and chrominance signals (R-Y) and (B-Y) or the like. 

20 The RGB image processing circuit 210 is a signal processing circuit for 

processing the pixel signals of the 1800 x 800 pixels received from the solid-state 
image pickup element 120 through the A/D converter 500, and has a white balance 
circuit, a gamma control circuit, and an interpolation circuit for making the 
resolution higher by interpolation. 
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The YC processing circuit 230 is a signal processing circuit for generating 
a luminance signal Y and chrominance signals R-Y and B-Y. The YC processing 
circuit 230 is formed of a high luminance signal generating circuit for generating a 
high luminance signal YH, a low luminance signal generating circuit for generating 
5 a low luminance signal YL, and a chrominance signal generating circuit for 

generating chrominance signals R-Y and B-Y. A luminance signal Y is formed by 
compositing a high luminance signal YH and a low luminance signal YL. 

The RGB image processing circuit 210 is now described in detail. 

RGB signals output outputtcd through the A/D converter 500 with regard 
10 to the R, G, and B regions, respectively, are first subjected subject to predetermined 
white balance adjustment in the white balance circuit in the RGB image processing, 
circuit 210, and then are subjected subject to predetermined gamma control in the 
gamma control circuit. 

The interpolation circuit in the RGB image processing circuit 210 „>■ 
1 5 generates, g e nerates by interpolation, image signals having a the resolution which is 
four times as much as that of the 600 x 800 pixels, converts the image signals from 
the solid-state image pickup element 120 into signals having high definition image 
quality, and supplies them to the high luminance signal generating circuit, the low 
luminance signal generating circuit, and the chrominance signal generating circuit 
20 at the subsequent stage. 

Since the sizes of the R, G, and B object images are already the same 
based on the setting of the objective lens 100, first, by a publicly known method, 
arithmetic processing for correcting optical aberration of the objective optical 
system is carried out with regard to the respective image signals. After that, the 
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interpolation processing, the luminance signal processing, and the chrominance 
signal processing which are the same as those of an ordinary digital color camera 
are performed. The interpolation processing is as follows. 

First, a G image signal, signal which is a reference image signal from the 
5 image pickup region 120a. 126a is subjected subject to interpolation according to 
the following equations (6) to (9): 

G2i2j = Gij , ... (6) 

G2i(2j+1) = Gij-1/2 + Gi(j+l) l/2 . . . (7) 

G(2i+l)2j = Gij-1/2 + G(i+l)j-l/2 ... (8) 

10 G(2il)(2j+l) = Gij-l/4 + Gi(j+l>l/4+ 

G(i+l)j-l/4 + G(i+l)G+l>l/4 ...(9) 
That This is, 16G elements are generated from each four G pixels, and thus the G 
image signals of 600 x 800 pixels from the image pickup region 120a are converted 
into 1200 x 1600 pixels. 
15 Then, R image signals from the image pickup region 120b corresponding to 

the respective positions of the G image signals calculated using the above equations 
(6) to (9) are subjected subject to interpolation according to the following equations 
(10) to (13): 

R2i2j = R(i-l)(j-l)-l/4 + R(i-l)j-l/4+ 
20 Ri(j-l)-l/4 + Rij-l/4 ...(10) 

R2i(2j+1) = R(i-l)j-l/2 + Rij-1/2 . . .(11) 

R(2i+l)2j = Ri(j-l)-'/2 + Rij-1/2 . . .(12) 

R(2i+l)(2j+l) = Rij ...(13) 
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Since, as described in th e above, the image pickup region of the R object 
image and the image pickup region of the B object image are arranged so as to be 
shifted by X A pixel from the image pickup region of the G object image, the original 
output of the ij address is applied to the (2i+l)(2j+l) address as indicated by the 
5 equation (13). 

Similarly to the R image signals, B image signals from the image pickup 
region 120c corresponding to the respective positions of the G image signals 
calculated using the above equations (6) to (9) are subjected subj e ct to interpolation 
according to the following equations (14) to (17): 
10 B2i2j = B(i-l)(j-l>l/4 + B(i-l)j-l/4+ 

Bi(j-l)-l/4 + Bij-l/4 . . . (14) 

B2i(2j+1) - B(i-l)-jl/2 + Bij-1/2 . . . (15) 

B(2i+l)2j = BiQ-l>l/2 + Bij-1/2 . . . (16) 

B(2i+l)(2j+l) = Bij . . . (17) 

15 By the above processing, the R, G, and B signals of 600 x 800 pixels from 

the image pickup regions 120a, 120b, and 120c are converted into R, G, and B 
signals of 1200 x 1600 pixels having high definition image quality, respectively. 

The high luminance signal generating circuit in the YC processing circuit 
230 is a publicly known signal forming circuit for forming a high luminance signal 
20 YH from a color signal having the highest spatial frequency component among 

color component signals. The low luminance signal generating circuit is a publicly 
known signal forming circuit for forming luminance signal YL of low frequency 
from a signal containing all the color components of R, G, and B. The chrominance 
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signal generating circuit is a publicly known arithmetic circuit for calculating 
chrominance signals R-Y and B-Y from high highly definition RGB signals. 

The recording and reproduction system 30 is a processing system for 
outputting image signals to the memory and outputting image signals to the liquid 
5 crystal monitor 4, and includes a recording processing circuit 300 for writing and 
reading image signals into m and from the memory and a reproduction processing 
circuit 310 for reproducing image signals read from the memory as output to the 
monitor. More specifically, the recording processing circuit 300 includes a 
compressing and expanding circuit for compressing YC signals representing a still 

10 image or a dynamic image according to a predetermined compression format and - 
for expanding the compressed data when it is read from the memory. The 
compressing and expanding circuit includes a frame memory for signal processing 
and the like. YC signals from the image processing system 20 are stored on a 
frame-by- frame frame basis, the signals are read on a plurality of blocks block 

15 basis, and the signals are compression encoded. The compression encoding is 
carried out by, for example, two-dimensional orthogonal transformation, 
normalization, and encoding according to the Huffman method on a block the block 
basis. 

The reproduction processing circuit 310 is a circuit for carrying out matrix 
20 conversion of the luminance signal Y and the chrominance signals R-Y and B-Y 
into, for example, RGB signals. Signals converted by the reproduction processing 
circuit 3 10 are output outputted to the liquid crystal monitor 4. Thus, a visible 
image is displayed and reproduced. 
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On the other hand, the control system 40 includes control circuits for 
controlling, in response to external operation, the image pickup system 10, the 
image processing system 20, and the recording and reproduction system 30, 
respectively. It detects depression of the RELEASE button 6 to control driving of 
5 the solid-state image pickup element 120, operation of the RGB image processing 
circuit 210, compression processing of the recording processing circuit 300, and 
the like. More specifically, the control system 40 includes an operation detection 
circuit 410 for detecting the operation of the RELEASE button 6, a system control 
unit 400 for controlling the respective portions in response to the detection signal 

10 and generating and outputting timing signals when an image is picked up and the : 
like, and a drive circuit 420 for the solid-state image pickup element 120, which, 
under control of the system control unit 400, generates drive signals for driving the 
solid-state image pickup element 120. 

Next, operation of the image pickup apparatus according to the present 

15 embodiment is described with reference to Figs. 14 and 17A to 17C. First, when the 
main switch 5 is turned on, power source voltage is supplied to the respective 
portions and then they become operable. Then, it is determined whether an image 
signal can be recorded or not in the memory. Here, the number of recordable 
pictures is displayed on the display area 13 for the remaining number of pictures in 

20 a liquid crystal monitor 4 according to the remaining capacity. An operator sees the 
display and, if a picture is recordable, directs the camera to the field and presses 
down the RELEASE button 6. 

When the RELEASE button 6 is pressed halfway pre ssed down, the 
exposure time is calculated. When all the preparatory processing for taking a 
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picture is completed, completes, the camera is in a recordable state, and the 
operator is informed of this through the display. When the RELEASE button 6 is 
ftrtty pressed down fully , the operation detection circuit 410 transmits the detection 
signal to the system control unit 400. Here, the exposure time calculated in 
5 advance is counted. When the predetermined exposure time has elapsed e la p ses , a 
timing signal is supplied to the drive circuit 420. Then, the drive circuit 420 
generates horizontal and vertical drive signals to sequentially read each of the 
exposed 1 600 x 800 pixels in the horizontal direction and in the vertical direction. 
The read signals of respective pixels are converted by the A/D converter 

1 0 500 into digital signals of a predetermined number of bits to be sequentially 

supplied to the RGB image processing circuit 210 of the image processing system 
20. The RGB image processing circuit 210 carries out interpolation to quadruple 
the pixel resolution after white balance adjustment and gamma control, and supplies 
the signals to the YC processing circuit 230. 

15 In the YC processing circuit 230, the high luminance signal generating 

circuit generates high luminance signal YH with regard to the respective RGB 
pixels, and similarly, the low luminance signal generating circuit generates low 
luminance signal YL. The calculated high luminance signal YH is output outputted 
to an adder through a low-pass filter. In the same way, the low luminance signal 

20 YL is, after subtraction of the high luminance signal YH, output outputted to the 
adder through the low pass filter, hi By this manner , the difference YL-YH 
between a high luminance signal and a low luminance signal is added to obtain a an 
luminance signal Y. Similarly, the chrominance signal generating circuit generates 
and outputs chrominance signals R-Y and B-Y. Components of the output 
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outputtcd chrominance signals R-Y and B-Y, which come through the low-pass 
filter, are supplied to the recording processing circuit 300. 

Next, the recording processing circuit 300 receives the YC signals, 
compresses compress the respective luminance signal Y and chrominance signals 
5 R-Y and B-Y with a predetermined still image compression method, and records 
them sequentially in the memory. 

In order to reproduce When a still image or a dynamic image is r ep r oduc e d 
from image signals stored in the memory, the PLAY button 9 is pressed down. 
Then, the operation detection circuit 410 detects this operation to supply a detection 
10 signal to the system control unit 400, which causes makes the recording processing 
circuit 300 to be driven. The driven recording processing circuit 300 reads the 
recorded content from the memory to display images on the liquid crystal monitor 
4. The operator selects the desired image by pressing down a SELECT button or 
the like. 

1 5 Fig. 1 8 shows another transmission factor distribution of transmission 

factor distribution type filters provided at positions facing the diaphragm openings 
1 10a, 1 10b, and 1 10c of the objective lens 100. The transmission factor changes so 
as to have multiple steps. The positions where the transmission factor of the 
transmission factor distribution type filters is the highest are made to correspond to 

20 the centers of the diaphragm openings 1 10a, 1 10b, and 1 10c while the positions 

where the transmission factor is zero are made to correspond to the periphery of the 
diaphragm openings 1 10a, 1 10b, and 1 10c, respectively. Fig. 19 is a front view of 
one of the transmission factor distribution type filters. Regions 600, 601, 602, and 
603 are formed coaxially with the circular diaphragm opening 1 10a. The 
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transmission factor decreases in the order of the region 600, the region 601, the 
region 602, and the region 603. 

Such a transmission factor distribution type filter is, similarly to the case 
of the first embodiment, formed by forming a thin film of Inconel, Chromel, 
5 chromium oir the like by vapor deposition or sputtering on the light incidence side 
of the objective lens 100. The characteristics shown in Fig. 18 can be obtained by 
making the thin film the thinnest in the center region 600 and thicker toward the 
periphery in the order of the region 601, the region 602, and the region 603. In 
forming such a thin film, the position of a mask used in the vapor deposition or 
10 sputtering is controlled. The position of the mask is controlled to have steps such ;, 
that the condition of the vapor deposition or sputtering is the same within each of 
the regions 600, 601, 602, and 603. As a result, the positioning positions of the 
mask becomes easy, and thus, the production facilities can be simplified. 

If such apodization is carried out, although, strictly speaking, the intensity 
15 of the diffraction stripes becomes greater than that of the first embodiment, its 
influence on the image is small, and thus, the filter of the present embodiment is 
sufficiently practical. 

In the case where the pixel pitch of the image pickup element is made 
larger, larg e r in the attempt to make smaller the size of the memory or to cut the 
20 amount of image processing, making high the contrast in a high frequency range 

becomes less necessary, and thus, the number of the steps of the transmission factor 
may be decreased , e.g., as shown in Fig. 20. 

Fig. 21 shows a third embodiment of an image pickup apparatus according 
to the present invention. Similarly to the case of the first embodiment, the 
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diaphragm 110 of an image pickup system 190 has the three circular openings 110a 5 
1 10b, and 110c. 110c as shown in Fig. 3. Object light which enters the objective 
lens from these openings is th e m ar e projected from the three lens portions 100a, 
100b, arid 100c of the objective lens 100 to form three object images on the image 
5 pickup plane of the solid-state image pickup element 120. 

The hatched portions 52a, 52b, and 52c sandwiched between the 
diaphragm 110 and the objective lens 100 are optical filters. As shown in Fig. 4^ 
which illustrates showing the objective lens 100 viewed from the light incidence 
side, the optical filters 52a, 52b, and 52c are formed in regions which completely 

10 include the diaphragm openings 1 10a, 1 10b, and 1 10c, respectively. 

The optical filter 52a has spectral transmission factor characteristics shown 
as G in Fig. (L 6 which mainly transmits transmit green, the optical filter 52b has 
spectral transmission factor characteristics shown as ^ R which mainly transmits 
transmit red, and the optical filter 52c has spectral transmission factor 

1 5 characteristics shown asB^B which mainly transmits t r ansmit blue. As the product 
with the characteristics of the infrared radiation cutting filter formed on the lens 
portions 100a, 100b, and 100c, the object images formed in the image circles 51a, 
51b, and 51c are of green light component, red light component, and blue light 
component, respectively. 

20 On the other hand, the optical filters 53a, 53b, and 53c are formed on the 

three image pickup regions 120a, 120b, and 120c, respectively, of the image pickup 
element 120. Their spectral transmission factor characteristics are equivalent to the 
ones shown in Fig. 6. More specifically, the image pickup regions 120a, 120b, and 
120c are sensitive to green light (G), red light (R), and blue light (B), respectively. 
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Since the spectral distributions of the received light of the respective 
image pickup regions are given as the product of the spectral transmission factors of 
the pupils and the spectral transmission factors of the image pickup regions, 
respectively, the combination of the pupil and the image pickup region is selected 
5 according to the wavelength range. More specifically, object light which goes 
through the diaphragm opening 1 10a is mainly photoelectrically converted in the 
image pickup region 120a, object light which goes through the diaphragm opening 
1 10b is mainly photoelectrically converted in the image pickup region 120b, and 
object light which goes through the diaphragm opening 1 10c is mainly 
10 photoelectrically converted in the image pickup region 120c. In other words, the ; 
image pickup regions 120a, 120b, and 120c output a G image, an R image, and a B 
image, respectively. 

Since the peak wavelength of the spectral luminous efficiency is 555 nm, 
the signal processing is carried out with a G image signal including this wavelength 
1 5 being as the reference image signal. 

The image pickup system 190 takes in three object images with regard to 
the three wavelength ranges, and thus, compared with an image pickup system 
provided with a mosaic optical filter, filter such as of the Bayer Baiyer arrangement 

having the same number of pixels, the focal length is about 1/ a/3 times to attain the 

20 same image pickup angle. Therefore, it is necessary to materialize image 
resolution r e solusion of higher spatial frequency component, component as 
described in the first embodiment. 
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Further, it is well known wctt that diffraction of light at a diaphragm 
opening decreases the contrast in an object image. The diffraction stripes can be 
decreased by adding to the objective lens a filter that is transparent at the center and 
becomes darker toward the periphery. This addition of the filter is referred to as 
5 apodization. However, generally, in the visible wavelength range with regard to a 
CCD or a CMOS sensor, the sensitivity on the side of blue is lower and the 
sensitivity becomes higher toward the long wavelength side, and thus, in the third 
embodiment, it is determined depending on the wavelength range whether 
apodization is adopted or not. 

10 As described irrthe above, since the image pickup regions 120a, 120b, and 

120c output a G image, an R image, and a B image, respectively, the sensitivity 
becomes higher in the order of the image pickup region 120c, the image pickup 
region 120a, and the image pickup region 120b. Accordingly, apodization is adopted 
only with regard to the diaphragm openings 1 10a and 110b, which 110b whcih 

15 corresponds to the image pickup regions 120a and 120b, respectively. 

Fig. 21 shows transmission factor distribution type filters 610a and 610b 
formed on the objective lens. The positions where the transmission factor is the 
highest are made to correspond to the centers of the diaphragm openings 1 10a, 
1 10b, and 1 10c while the positions where the transmission factor is zero are made 

20 to correspond to the periphery of the diaphragm openings 1 10a, 1 10b, and 1 10c, 
respectively. 

In other words, the transmission factor is distributed so as to be the highest 
at the centers of the diaphragm openings and so as to monotonically decrease 
toward the periphery. 
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Taking into consideration the spectral luminous efficiency characteristics, 
further simplification may be carried out. The spectral luminous efficiency reaches 
its peak at 555 nm, and the sensitivity lowers from the peak both on the short 
wavelength side and on the long wavelength side. It follows that, even if the 
5 definition of an R image and a B image is lower than that of a G image including 
the peak wavelength of the spectral luminous efficiency, it is difficult to find a 
defect for a person who evaluates a color image which is a composite image of the 
three images. Therefore, apodization is omitted with regard to the diaphragm 
opening 1 10b corresponding to the image pickup region 120b for forming an R 

10 image, and apodization is adopted only with regard to the diaphragm opening 1 10a 
corresponding to the image pickup region 120a. Fig. 22 explains this, and a 
transmission factor distribution type filter 611a of an image pickup system 191 is 
formed on the objective lens. 

By decreasing the region where the transmission factor distribution type 

15 filter is formed, the production process of the objective lens 100 is simplified. This 
is advantageous from the viewpoint of the cost. 

As described in the above, in an image pickup apparatus comprising an 
image pickup optical system and an image pickup element having a plurality of 
image pickup regions, wherein a plurality of images corresponding to the plurality 

20 of image pickup regions are projected onto the image pickup element through the 
image pickup optical system, the image pickup optical system is formed so as to 
have a plurality of imaging systems and the imaging systems are provided with 
optical filtering means whose transmission factor becomes smaller as the distance 
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from the optical axis of the imaging system itself becomes longer. Thus, the 
apparatus of the present invention can attain the following effects. 

(1) An image pickup optical system can be materialized which is suitable 
for a thin image pickup apparatus and capable of obtaining a high definition image. 

5 In addition, an optical filter is constructed such that the transmission factor 

thereof becomes smaller in multiple stages as the distance from the optical axis of 
the imaging system becomes longer. Then, the following effect also can be 
obtained. 

(2) A simply structured image pickup optical system can be materialized 
10 which is suitable for a thin image pickup apparatus and capable of obtaining a high 

definition image. 

Further, in an image pickup apparatus comprising an image pickup optical 
system and an image pickup element having a plurality of image pickup regions, 
wherein a plurality of images corresponding to the plurality of image pickup regions 

15 are projected onto the image pickup element through the image pickup optical 
system, the image pickup optical system is formed with an imaging system 
provided with optical filtering means whose transmission factor becomes smaller as 
the distance from the optical axis of the imaging system itself becomes longer, and 
an imaging system which is not provided with such optical filtering means. Thus, 

20 the following effect can be also obtained. 

(3) An image pickup optical system can be materialized which is suitable 
for obtaining a high definition image with regard to a wavelength range having a 
high spectral luminous efficiency and for compensating for the sensitivity of the 
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image pickup element with regard to a wavelength range having a low spectral 
luminous efficiency. 

The individual components shown in schematic or block form in the 
drawings are all well-known in the camera arts and their specific construction and 
5 operation are not critical to the operation or best mode for carrying out the 
invention. 

While the present invention has been described with respect to what is 
presently considered to be the preferred embodiments, it is to be understood that the 
invention is not limited to the disclosed embodiments. To the contrary, the 

10 invention is intended to cover various modifications and equivalent arrangements 
included within the spirit and scope of the appended claims. The scope of the 
following claims is to be accorded the broadest interpretation so as to encompass all 
such modifications and equivalent structures and functions. 

For example, in the described embodiments, optical filters used for the . 

15 color separation are primary color filters of red, green, and blue. However, the 
present invention is also applicable to a case where these filters are replaced by 
complementary color filters of cyan, magenta, and yellow. 

Further, in the above embodiments, an object image having the highest 
luminosity factor (green) is used as a reference to describe change in the intervals 

20 between the object image having the highest luminosity factor and object images 
having other luminosity factors (other colors), which is caused by change in the 
distance to the object. However, the present invention is also applicable to a case 
where an object image having the highest luminosity factor (green) is not used as 
the reference. 
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It is to be noted that, in the present invention, the respective embodiments 
in the above or technical elements thereof may be freely combined depending on 
the situation. 

Also, in the present invention, the whole or part of the appended claims or 
5 of the structure of an embodiment may form one apparatus, may be combined with 
another apparatus, or may be an element of an apparatus. 
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ABSTRACT OF THE DISCLOSURE 

An image pickup apparatus comprising a plurality of image pickup 
portions for receiving different wavelength components of object light, and a 
5 plurality of optical systems for guiding the object light to the plurality of image 
pickup portions, respectively, each of the plurality of optical systems having a 
filtering function whose transmission factor becomes smaller as the distance from 
an optical axis, thereof becomes longer. 

10 

CPW\gmc 
DC_MAIN 164309v1 



